Imitating Chemical Motors with Optimal Information Motors 
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To induce transport, detailed balance must be broken. A common mechanism is to bias the 
dynamics with a thermodynamic fuel, such as chemical energy. An intriguing, alternative strategy 
is for a Maxwell demon to effect the bias using feedback. We demonstrate that these two different 
mechanisms lead to distinct thermodynamics by contrasting a chemical motor and information 
motor with identical dynamics. To clarify this difference, we study both models within one unified 
framework, highlighting the role of the interaction between the demon and the motor. This analysis 
elucidates the manner in which information is incorporated into a physical system. 
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Information is physical [l^: it must be recorded in a 
physical memory, and therefore the processing of infor- 
mation is constrained by the same thermodynamic limi- 
tations as any other physical process [2, 3]. Remarkably, 
once that information has been obtained, it can then 
serve as a thermodynamic resource similar in character to 
free energy, as first pointed out by Szilard [4] . These two 
observations have been the historic points of departure 
for investigations into the nature of information ii. As 
a consequence, research has either focused on the manip- 
ulation of information in isolated memories, or simply on 
the engines that utilize that information. This division 
has been fruitful. Theoretical studies of isolated mem- 
ories, which have been verified by experiment have 
led to insights into the thermodynamic costs of measure- 
ment [g] and erasure [7-^12] ; copying lisl , [l^ ; and proof- 
reading 1.1 31 : whereas, theoretical jl5l42l| and experimen- 
tal [22|, |23| investigations of information (or feedback) 
motors have explored the fundamental limits to the con- 
version of information into work. 

Nevertheless, the thermodynamic qualities of informa- 
tion still need to be clarified, especially the precise mech- 
anism that allows a motor to exploit the information 
stored in a memory to rectify thermal fluctuations. With 
this goal in mind, we highlight in this Letter the differ- 
ence between information and a more traditional ther- 
modynamic resource, the chemical free energy. We elabo- 
rate this distinction by comparing the entropy production 
rates of two motors with identical dynamics: a chemical 
motor powered by a chemical potential energy gradient 
and an information motor driven by feedback. Despite 
the identical dynamics, the information motor presents 
qualitatively different thermodynamics. We trace this 
discrepancy to the features of the interaction between 
the motor and the memory. We find that in order for the 
information to be a useful thermodynamic resource, this 



interaction must create long-lived correlations. 

Our motors are patterned on the Brownian ratchet [24 1 
pictured in Fig. [TJ The ratchet is composed of a particle 
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FIG. 1. Depiction of the Brownian ratchet template. A 
particle moves in a periodic potential of period / against a 
force F = 2AE/1 with rates rLR and ruL. The potential 
makes random switches between two configurations mediated 
by either a chemical reaction (chemical motor) or a demon 
(information motor). Potential switches induce transitions 
R ^ L at rates qlr and qRL- 

driven against a force F by a flashing periodic potential. 
The potential fluctuates between two configurations con- 
sisting of a series of offset infinite barriers that confine 
the particle to boxes of length I. Within each box the 
particle has two spatial states: z = L (left) and a higher 
energy state R (right) with energy difference AE = Fl/2. 
We model the transitions between R and L as a discrete 
Markov jump process [25], and we set the units of en- 
ergy by fixing the temperature, kT = 1. Diffusive jumps 
within each box are thermally activated with rates tlr 
{'^rl) from Rio L {L to R) that verify detailed balance, 
tlr/trl = [26]. Transitions effected by switching 
the potential's configuration occur with rates qlr {qrl) 
for R ^ L {L ^ R) and are induced by a different mech- 
anism in each motor^ see Fig.[Tl Furthermore, these tran- 
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sit ions do not require energy, as we assume that R (L) 
in the lower configuration in Fig. [1] has the same energy 
as L (R) in the upper. The ratchet functions as long 
as the R ^ L transitions occur more often than the re- 
verse, L ^ R. In which case, the current J - the average 
net number of jumps per unit time against the load - is 
positive, and work is extracted at a rate 



JAE. 



(1) 



It will prove convenient in our subsequent calculations 
to assume that potential switches are slow compared to 
the spatial transitions {q <C r). In this limit, the parti- 
cle has sufficient time between successive switches of the 
potential to relax to the equilibrium probability density 
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(2) 



Consequently, J = qlrPr - QrlPl- 

In the chemical motor, the potential switches are bi- 
ased by coupling them to an out-of-equilibrium chemical 
reaction between species A and B through the formula 
R ^ A ^ L -\- B. Detailed balance enforces that the 
chemical potential energy difference between A and B, 
A/i = /iA - Mb > 0, satisfies A/a = \n{qLR/qRL)- The re- 
sulting kinetic-diffusion scheme corresponds to the min- 
imal tight-coupled chemical motor extensively used to 
model protein motors and pumps [26]. When A/i > AE^ 
Wext [Eq. ([1])] is extracted by consuming chemical free 
energy per unit time Fchem = JAji. The resulting en- 
tropy production rate is |26| 

^(chem.mot.) ^ p^^^^ _ ^^^^ ^ _ > q (3) 

To contrast with the chemical motor, we now consider 
an information motor driven by feedback implemented 
by a device, or so-called demon, that switches the poten- 
tial in response to measurements of the particle's posi- 
tion. Here, the information is the resource that powers 
the ratchet, whereas chemical energy was used by the 
chemical motor. 

In order for the information motor to reproduce the 
stochastic potential switches of the ratchet, the demon 
must perform measurements at random times separated 
by intervals sampled from a Poisson distribution with 
rate a = qRL-\-QLR [25]. This scheme may be interpreted 
as the demon attempting to make a measurement in each 
small interval of time St^ but only succeeding with prob- 
ability aSt <C 1. When the demon succeeds, it measures 
R OT L with a symmetric error, mistaking R (L) for L 
(R) with probability e = QRL/iQRL + Qlr)^ and fiips the 
potential when the outcome is R. Moreover, the demon 
records the sequence of potential switches in a memory 
with states m, though for now we leave unspecified the 
recording mechanism. When the demon fails to make a 
measurement or the outcome is L, the memory is put in 



state m = for no-switch; whereas, when the outcome 
is i?, the memory is set to S for switch. 

With this setup, potential switches occur at rates 
Qlr = <^(1 — and qhl = <^e, as desired. Compari- 
son with the chemical motor leads to the correspondence 
A/i = ln[(l — e)/e]: e = is equivalent to A/i = oo, 
whereas e = 1/2 corresponds to an equilibrium fuel, 
A/i = 0. 

We now need to determine the information motor's en- 
tropy production rate. For this we will use the framework 
introduced in Refs. 12, 2o|, 27-33|] for the analysis of mea- 
surement and feedback. We will validate this approach 
later using a concrete physical realization. The frame- 
work's main features can be simply obtained by intro- 
ducing a nonequilibrium free energy [s^. Ell for a system 
whose mesoscopic states x are in local equilibrium [36^. 
To each system configuration X = {px^ Fx} characterized 
by the free energy Fx and probability px to be in x, we 
assign a nonequilibrium free energy 

:F{X) = Y.^xFx - kTH{X) = F{X) - kTH{X), (4) 

X 

where H{X) is the Shannon entropy [ST^. We call 
F{X) = ^PxFx the hare free energy. In equilibrium, 
pV" = e~^^'^ /Z with Z = X]e~^^^, and we recover the 
equilibrium free energy J^^^ = —kTlnZ. The utility of 
stems from the observation that the (irreversible) en- 
tropy production in a transition between nonequilibrium 
configurations is the amount by which the work W ex- 
ceeds the increment in the nonequilibrium free energy 
AT (kT = l) [d,[35|: 



AiS = W - AF> 0. 



(5) 



Here, we are interested in the entropy production for 
the coupled memory and ratchet, X = (M^Z), during 
measurement and feedback. An ideal classical measure- 
ment correlates the initially uncorrelated memory and 
ratchet, J^{M,Z) = J'(M) + J'(Z), through an isother- 
mal process without affecting the ratchet, F{Z') = T{Z)^ 
though possibly changing the nonequilibrium free energy 
of the memory to T{M') ^ T{M) Upon comple- 

tion of the measurement the nonequilibrium free energy 
in Eq. (|4]) can be cast into a useful form using the mutual 
information [s^ 

/(M^ Z) = H{M') + H{Z) - H{M\ Z), (6) 



as 



T{M\ Z') = F{M') + J^{Z) + /(M^ Z), (7) 

assuming that before and after the measurement the bare 
free energies are additive, F(M, Z) = F{M)^F{Z). The 
mutual information is a measure of correlations satisfy- 
ing / > with / = only when M' and Z are indepen- 
dent [13 • Consequently, the creation of correlations, or 
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measuring, increases the nonequilibrium free energy, re- 
quiring work Wmeas ^ud producing entropy in accordance 
with Eqs. © and (O SEIll, 



^i^meas 

I^^eas-A^(M,Z) 

= W^e.s - A^(M) - /(M^ Z) > 0, 



(8) 



where AJ^(X) = J^{X') - J^{X). 

Once the correlations have been estabhshed, they can 
be exploited through an isothermal process that extracts 
work Wext from the ratchet by changing its nonequil- 
birium free energy to J^{Z") ^ without alter- 

ing the memory, T{M") = J^{M'). This scenario, 
which we call feedback, ideally will produce an entropy 
[Eq. @] 



AiSfk = I{M', Z) - b.T{Z) - VText > 0, 



(9) 



when all the correlations are removed. For cyclic feed- 
back protocols, as we consider here, AJ^{Z) = 0. Only 
when the measurements are reversible (A^S'meas = 0) 
does Eq. ([9j) represent the total entropy production for 
the entire measurement and feedback cycle. In general, 
AiSfh is only a lower bound. 

Now, since the information motor utilizes feedback, we 
can use Eq. (j9j) to calculate the (minimum) entropy pro- 
duction rate. From Eq. (|9]), we see that we must calcu- 
late /. To this end, we first observe that the fast dif- 
fusion implies that the ratchet begins each 5t with the 
same equilibrium probability density [Eq. ([2])]. Conse- 
quently, each interval is independent, and each N or S 
is recorded instantaneously in an independent memory. 
In this case, there are no correlations between succes- 
sive measurement outcomes, allowing us to analyze each 
measurement separately. We then obtain / from the the 
probability density p^^ ^ for the composite system at the 
end of an interval. 
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Upon substituting this into Eq. ^ and expanding to first 
order in St^ we arrive at 



I = ji - PrQlr In h PlQrl m . 

ot qs qs 



(11) 



where qs = {p^ s ~^ Pl s)/^^ switching rate. Then 

by combing Eqs. '([1]), and 1^ with AT{Z) = 0, 
we find for the entropy production rate ^'(info.mot.) _ 
AiSfh/^t the form 
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(12) 



In Fig. H we compare S'(chem.mot.) ^q. (|3|)] and 
^'(info.mot.) ([j2|)] as functions of A^. Clearly, the 
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FIG. 2. Plot of the entropy production rates for the chemi- 
cal motor, 5'(^hem.mot.) ^^le information motor, 
^(info.mot.) ^21)], as functions of the external force 
for quL — 1 and A/i — ln[(l — e)/e] = 1. 



different switching mechanisms lead to qualitatively dif- 
ferent thermodynamics, even though the dynamics are 
the same. Most notable is that the information mo- 
tor can operate with zero entropy production at a finite 
current when AE = A/i/2. By contrast, the chemical 
motor reaches the reversible limit only at the stall force 
AE = Aji when J = 0. 

This analysis, however, ignores the interaction between 
the memory and ratchet, which obscures the dynamic 
transfer of information encoded in Eqs. (|8]) and (|9]). To 
clarify the role of this interaction, we now analyze an ex- 
tension of the information motor where the memory and 
measurement recording mechanism are included explic- 
itly, building on the mechanical Maxwell's demon intro- 
duced by Mandal and Jarzynski [38]. 

We model the memory as a tape composed of a series 
of two-state cells (or bits) with states m = N^S with 
corresponding free energies = and Fs = fo ^ oo. 
Initially, each cell is in A/" - which is equilibrium {pN = 1, 
ps = 0). One at a time, each cell couples to the motor 
for a duration ri , short compared to the diffusion (rri ^ 
1), through a very fast reaction that induces potential 
switches according to the scheme in Fig.[3l For the motor 
to function, we bias the R ^ L potential switches by 
mediating this transition with the same pair of out-of- 
equilibrium chemicals, A and 5, used in the chemical 
motor with A/i = \'n.{qLR/ qRh) through the formula R -|- 
N ^ L-\-S-\-B. Furthermore, during ri we lower the 
free energy of 5* from Fs = fo to f = — \n{qiiLSt) ^ 1 
quasistatically^ though fast compared to diffusion. Thus, 
the diffusion is frozen, while the reactions R-\-S ^ L-\-N 
and R-\-N-\-A ^ L-\-S-\-B independently evolve through 
a sequence of equilibrium states. Next, the cell decouples, 
and the motor relaxes to equilibrium by spatial diffusion 
for a time r2 ^ 1/r such that St = ri+r2 is the total cycle 
time. Repeating this sequence of actions - coupling a cell. 
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FIG. 3. Illustration of the extended information motor that is 
fed by a tape of two-state {N and S) cells each initially in N 
and separated by a time interval T2 (upper figure). Each cell 
couples to the ratchet for a duration n during which the free 
energy of S is quasistatically lowered from /o ^ oo to / while 
the reactions R + S ^ L + N and R + N + L + S + B 
individually evolve in a time-dependent free energy landscape 
(lower figure). 



lowering F^, decoupling, and then relaxing diffusively - 
reproduces the dynamics of the ratchet, as can be verified 
by demonstrating that the joint density p'^ ^ at the end 
of the interval equals Eq. ([TOj) to order 5t. 

The thermodynamic analysis of each Jt-cycle naturally 
decomposes into two steps: the establishment of correla- 
tions, or measurement, during ri, and the spatial relax- 
ation during T2 when the correlations are converted into 
work. 

During ri, work is done by the A ^ 5 reaction, 
W:hem = p'l s^I~^ \^^' ^P^ ]- ^ind by quasistatically low- 
ering Fs from /o ^ 00 to /, which to order 5t is 
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df^-p^s. (13) 



where p'^ = qsSt = p'r s ^ p'l s- This work is used to 
form correlations I{M\Z) [Eq. (pT]) ] while changing the 
memory's nonequilibrium free energy from J^{M) = 
{PN = 0) by AJ='{M) = T{M') = p'sf-Ws)^ where h is 
the binary Shannon entropy [37]. Inserting these expres- 
sions into Eq. ([8]), reveals, after a cumbersome though 
straightforwarded algebraic manipulation, that 



f H^chem - A^(M) - /(M', Z) = 0, 

(14) 

saturating the bound in Eq. (j8j). Our protocol is re- 
versible because the initially equilibrium memory (/o 
00, ps- = 0) couples to an equilibrium ratchet, followed 
by a quasistatic isothermal shift in Fs. 

The cycle is completed as the motor relaxes. / is con- 
verted into work VFext = JStAE through a decrease of 



the nonequilibrium free energy to T{M" ^ Z") = F{M')^ 
T{Z). The resulting entropy production from Eq. (j5j) is 
AiS'diff = I{M',Z) - JStAE > 0, reproducing per cy- 
cle the entropy production rate of the information mo- 
tor AiSdm/St = S'(info.mot.), xhus, the total entropy 
production per cycle is A^S'tot = A^^meas + A^S'diff = 
^(info.mot.)^^^ proving that we have a nonautonomous 
model for the information motor without explicit feed- 
back that has the same dynamics and thermodynamics. 

An insightful alternative formulation of A^^difr is 
through the conditional entropy production A^iSdiffim foi" 
the subensemble with m = N^S: A^S'diff = P^A^S'diffi^ + 
(1 — P5)AiS'diff|Ar. Since switches are rare {p^^ ~ <C 1), 
the subensemble with m = N deviates little from equilib- 
rium, and therefore A^S'diffiAr ^ is negligible. On the 
other hand, A^^'diffi^ = ^E{Pr\s-Pr)^Hpr)-HPr\s)^ 
with p'^i^ = p'r^s/p's^ which vanishes only if p'^^g = p'j^^ 
or equivalently AE = A/i/2. In this situation, the prob- 
ability density of the particle after measurement given a 
switch p'^^g is identical to equilibrium pR. In which case, 
not only is the measurement reversible, but the entire op- 
eration of the composite system is reversible, in the same 
spirit as other reversible controlled systems analyzed in 
Refs. [13, Ell. 

In conclusion, we have demonstrated an explicit phys- 
ical mechanism that allows information to be stored in a 
memory and later utilized. Central to this mechanism is 
the two-step interaction mediated by the tape that cre- 
ates long-lived correlations [Eq. (p!Q|) ] and leads to the 
appearance of the mutual information in the thermody- 
namic accounting [Eq. (p!4|)]. The sequential structure of 
the tape, however, seems less important. We could also 
reproduce the same behavior using a chemical reservoir 
of molecules N and 5, as long as their was a mecha- 
nism establishing stable correlations for fixed intervals. 
Remarkably, similar long-lived complexes are common in 
biology: they can be observed in the non-Poisson statis- 
tics of molecular motors [s^, enzymatic catalysis liol l, 
and sensory adaption 
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It would be interesting to 
check if such complexes serve as a free energy storage 
and to uncover their role in information processing. 
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